IoT-based self-checkout stores using face mask detection

Currently, the world is witnessing a second wave of the Covid-19 pandemic, and the situation is getting worse day by day. Simple protocols like minimising human contact and wearing a mask outdoors are proving to be good measures to control the spread of the virus. We saw a huge rise in the demand for daily items and due to a lack of availability, large numbers of people gather without taking any precautions to stock essentials. This has led to the spread of the virus to a great extent. In self-checkout stores, the shopping experience is completely automated and there is no physical presence of the shop owner. The automation enables the customers to pick their goods, scan and make payments by themselves without the intervention of the owner or a cashier. In such stores there is a high chance of people not following Covid protocols. So, there is a need for a system that maintains an allowed threshold of people inside the store at any one time, thus minimizing the potential dangerous human contact at all possible cases. We propose an IoT-Based Self-Checkout Store Using Mask Detection. The primary goal of this project is to create a safe environment for the consumers who visit the shop, by keeping a check on the number of customers present at the store and ensuring that each and every customer is following the protocol of wearing a mask. The system consists of two parts, the face mask detection and the customer count. For the mask detection part, deep learning algorithms like CNN are used to generate a model that helps detect a mask, and for the customer count part, a threshold value is set, which gives us the maximum number of people allowed inside the store at a time. The PIR sensors detect the entry and exit of customers and help regulate the count below the threshold. So once the face mask detection of the customer is complete and the number of people present inside the store is checked, the system takes the decision of either allowing the customer inside or asking him or her to wait. This project is designed to provide a solution to the current real-world problem using minimally efficient technology with high accuracy. © 2023 Scrivener Publishing LLC. All rights reserved.

Detection of Real Time Face Mask using Convolutional Neural Network

In recent years, the global pandemic like COVID - 19 has changed the lifestyle of people. Wearing face mask is must in order to stay safe and healthy. This paper presents a real-time face mask detector which identifies whether a human is wearing a mask or not. Moreover, this system can also recognize the person wearing a face mask inappropriately or wear other things except a face mask. The proposed algorithm for face mask detection in this system utilizes Haar cascade classifier to detect the face and Convolutional Neural Networks to detect the mask. The whole system has been demonstrated in a practical application for checking people wearing face mask. © 2023 IEEE.

A hybrid tiny YOLO v4-SPP module based improved face mask detection vision system.

Law offenders take advantage of face masks to conceal their identities and in the present time of the COVID-19 pandemic wearing face masks is a new norm which makes it a daunting task for the investigation agencies to identify the offenders. To address the issue of detection of people wearing face masks using surveillance cameras, we propose a novel face mask vision system that is based on an improved tiny YOLO v4 object detector. The face masks detection network of the proposed vision system is developed by integrating tiny YOLO v4 with spatial pyramid pooling (SPP) module and additional YOLO detection layer and tested and validated on a self-created face masks detection dataset consisting of more than 50,000 images. The proposed tiny YOLO v4-SPP network achieved a mAP (mean average precision) value of 64.31% on the employed dataset which was 6.6% higher than tiny YOLO v4. Specifically, for detection of the presence of a small object like a face mask on the face region, the proposed tiny YOLO v4-SPP based vision system achieved an AP (average precision) of 84.42% which was 14.05% higher than the original tiny YOLO v4 thus, ensuring that the proposed network is capable of accurate detection of a mask on the face region in real-time surveillance applications where visibility of complete face area is a guideline.

A Face Detection and Standardized Mask-Wearing Recognition Algorithm.

In the era of coronavirus disease (COVID-19), wearing a mask could effectively protect people from the risk of infection and largely reduce transmission in public places. To prevent the spread of the virus, instruments are needed in public places to monitor whether people are wearing masks, which has higher requirements for the accuracy and speed of detection algorithms. To meet the demand for high accuracy and real-time monitoring, we propose a single-stage approach based on YOLOv4 to identify the face and whether to regulate the wearing of masks. In this approach, we propose a new feature pyramidal network based on the attention mechanism to reduce the loss of object information that can be caused by sampling and pooling in convolutional neural networks. The network is able to deeply mine the feature map for spatial and communication factors, and the multi-scale feature fusion makes the feature map equipped with location and semantic information. Based on the complete intersection over union (CIoU), a penalty function based on the norm is proposed to improve positioning accuracy, which is more accurate at the detection of small objects; the new bounding box regression function is called Norm CIoU (NCIoU). This function is applicable to various object-detection bounding box regression tasks. A combination of the two functions to calculate the confidence loss is used to mitigate the problem of the algorithm bias towards determinating no objects in the image. Moreover, we provide a dataset for recognizing faces and masks (RFM) that includes 12,133 realistic images. The dataset contains three categories: face, standardized mask and non-standardized mask. Experiments conducted on the dataset demonstrate that the proposed approach achieves mAP@.5:.95 69.70% and AP75 73.80%, outperforming the compared methods.

Face Mask Classification based on Transfer Learning and MobileNet V2

Face mask image recognition can detect and monitor whether people wear the mask. Currently, the mask recognition model research mainly focuses on different mask detection systems. However, these methods have limited working datasets, do not give safety alerts, and do not work appropriately on masks. This paper aims to use the face mask recognition detection model in public places to monitor the people who do not wear the mask or the wrong mask to reduce the spread of Covid-19. The mask detection model supports transfer learning and image classification. Specifically, the collected data are first collected and then divided into two parts: with_mask and without_mask. Then authors build, implement the model, and obtain accurate mask recognition models. This paper uses and size of images datasets tested respectively. The experimental results show that the effect of the image size of was relatively better, and the training accuracy of different MobileNetV2 models is about 95%. Our analysis demonstrates that MobileNetV2 can correctly classify Covid-19. © 2022 ACM.

Face mask detection based on improved YOLOv3 algorithm

In the current situation of COVID-19 prevention and control, wearing masks remains an important way to prevent the transmission of the Novel Coronavirus. Aiming at the problem that the detection accuracy of the traditional YOLOv3 algorithm can still be improved, this paper proposes an improved yolov3 algorithm and applies it to the practical problem of detecting whether to wear a mask. Firstly, the algorithm introduces the residual structure of structural reparameterization in the feature extraction network named Darknet53 of YOLOv3 to obtain the input features;Secondly, the SimSPPF (Simplified Spatial Pyramid Pooling-Fast) is introduced to enhance feature extraction;Finally, an improved attention mechanism is introduced to make the model focus on regions with more prominent features. Besides, in order to ensure the accuracy of target detection, CIoU and Focal loss function was used in the training process. The results show that compared with the traditional YOLOv3, the detection accuracy of the improved algorithm for normal face and mask face is improved by 16.98% and 7.30% respectively, and the mAP is improved by 12.14%, which can meet the requirements of daily use and lay a foundation for rapid face recognition when wearing mask. () © 2023 IEEE.

Automated Face Mask Detection using Artificial Intelligence and Video Surveillance Management

Surveillance camera has become an essential, ubiquitous technology in people's daily lives, whether applicable for home surveillance or extended to public workplace detection. The importance of the camera is irreplaceable in terms of the agent for an enclosed system to function correctly. The goal of ubiquitous computing is to keep different devices or technology communicating seamlessly, allowing them to expand to other areas instead of limiting it to one device. However, many research papers have been released on how the camera can aid in the current situation where COVID-19 is still raging worldwide, especially in crowded places. This paper aims to suggest a method by which surveillance cameras on the university campus can automatically detect student face mask status and notify them. Alongside that, this concept of applying a video management system within the university campus will assist in the automation of invigilating the student's daily mask status from the number of embedded surveillance cameras around the campus. © 2023 IEEE.

COVID-19 SOP Compliance and Monitoring Electronic System for Business and Public Places Using Arduino Uno

COVID-19 Corona virus disease is a rapidly spreading contagious disease that is causing a global public health crisis. In December 2019, the coronavirus was identified in Wuhan, China. COVID-19 is causing severe disease issues and many people are losing their lives daily. SARS-CoV-2 (Severe Acute Respiratory Syndrome coronavirus 2) is a severe infectious disease that is spreading very fast and is currently inflicting a healthcare crisis across the globe. The lethal coronavirus was founded in Wuhan, China in December 2019. The symptoms of this disease are fever, cough, fatigue, no taste or smell, stinging throat, headache, and difficulty in breathing. This deadly disease, COVID-19, is difficult to identify and spread. The vaccination process is still going on around the world. There are some existing strategies to minimize the spread of the COVID-19 virus by monitoring the temperature rise using sensors, wearing masks, and sanitizing their hands frequently. The proposed system comprises of an RFID reader, an IR sensor, a temperature sensor, a buzzer, a laptop or a personal computer with a web cam. A person on entry gets detected for their body temperature, wearing a face mask and then sanitizing their hands. If the temperature of the person is below 37.6 degrees, i.e., below the acceptance limit, then mask detection takes place by using MATLAB followed by spraying the sanitizer. Now the door will open automatically. Otherwise, the door will not open and the buzzer will sound. With these precautionary steps, people can survive this pandemic situation. © 2023 IEEE.

Real Time Mask Detection using Convolutional Neural Network

With the advent of Convolutional Neural Networks, the field of image classification has seen tremendous growth, with various previously impossible applications now being pursued. One such application is face mask detection, which is an important problem to solve, considering recent pandemic. The novelty of this work is the training of YOLO (You Only Look Once) framework for custom object detection, which in this case is face mask, based on some empirical rules for fine-tuning the performance. Also, image classification is proposed to be combined with tracker, in order to implement real world access grant system based on compliance shown by mask wearer. © 2022 IEEE.

Unconstrained face mask and face-hand interaction datasets: building a computer vision system to help prevent the transmission of COVID-19.

Health organizations advise social distancing, wearing face mask, and avoiding touching face to prevent the spread of coronavirus. Based on these protective measures, we developed a computer vision system to help prevent the transmission of COVID-19. Specifically, the developed system performs face mask detection, face-hand interaction detection, and measures social distance. To train and evaluate the developed system, we collected and annotated images that represent face mask usage and face-hand interaction in the real world. Besides assessing the performance of the developed system on our own datasets, we also tested it on existing datasets in the literature without performing any adaptation on them. In addition, we proposed a module to track social distance between people. Experimental results indicate that our datasets represent the real-world's diversity well. The proposed system achieved very high performance and generalization capacity for face mask usage detection, face-hand interaction detection, and measuring social distance in a real-world scenario on unseen data. The datasets are available at https://github.com/iremeyiokur/COVID-19-Preventions-Control-System.

A novel DeepMaskNet model for face mask detection and masked facial recognition

Coronavirus disease (COVID-19) has significantly affected the daily life activities of people globally. To prevent the spread of COVID-19, the World Health Organization has recommended the people to wear face mask in public places. Manual inspection of people for wearing face masks in public places is a challenging task. Moreover, the use of face masks makes the traditional face recognition techniques ineffective, which are typically designed for unveiled faces. Thus, introduces an urgent need to develop a robust system capable of detecting the people not wearing the face masks and recognizing different persons while wearing the face mask. In this paper, we propose a novel DeepMasknet framework capable of both the face mask detection and masked facial recognition. Moreover, presently there is an absence of a unified and diverse dataset that can be used to evaluate both the face mask detection and masked facial recognition. For this purpose, we also developed a largescale and diverse unified mask detection and masked facial recognition (MDMFR) dataset to measure the performance of both the face mask detection and masked facial recognition methods. Experimental results on multiple datasets including the cross-dataset setting show the superiority of our DeepMasknet framework over the contemporary models. (C) 2021 The Authors. Published by Elsevier B.V. on behalf of King Saud University.

Enhancing YOLOv3-tiny for Mask Detection in Natural Scenes

With the worldwide spread of COVID-19, people's life safety has been greatly threatened. So, we consider using YOLOv3-tiny algorithm to detect mask wearing. Since there are few detection models for correctly wearing masks, we decided to use three classifications to detect correctly wearing masks, incorrectly wearing masks, and not wearing masks. Besides, in order to enhance the performance of our model in small object detection, we propose the k-means++ algorithm to make the size of the initial anchor boxes closer to the actual size of the object, and add a YOLO detection layer to effectively improve the accuracy of a small object. The results show that the mAP@50 values of our model are 4.68% higher than YOLOv3-tiny algorithm. Our model has significantly improved the detection ability of crowd scenes, and mask detection is more accurate and robust, which has good application value for mask detection in natural scenes. © 2022 IEEE.

A study of quadratic Diophantine fuzzy sets with structural properties and their application in face mask detection during COVID-19

During the COVID-19 pandemic, identifying face masks with artificial intelligence was a crucial challenge for decision support systems. To address this challenge, we propose a quadratic Diophantine fuzzy decision-making model to rank artificial intelligence techniques for detecting masks, aiming to prevent the global spread of the disease. Our paper introduces the innovative concept of quadratic Diophantine fuzzy sets (QDFSs), which are advanced tools for modeling the uncertainty inherent in a given phenomenon. We investigate the structural properties of QDFSs and demonstrate that they generalize various fuzzy sets. In addition, we introduce essential algebraic operations, set-theoretical operations, and aggregation operators. Finally, we present a numerical case study that applies our proposed algorithms to select a unique face mask detection method and evaluate the effectiveness of our techniques. Our findings demonstrate the viability of our mask identification methodology during the COVID-19 outbreak. © 2023 the Author(s), licensee AIMS Press.

Face mask detection using deep convolutional neural network and multi-stage image processing

• A customized image dataset is built for research on face mask detection. • The dataset is manually labeled to provide high annotation accuracy. • For Face mask detection customized CNN with multi-step image processing is used. • The performance of the proposed CNN is compared with YOLO v3 and Faster R-CNN. • Two publicly available datasets including MAFA and MOXA used for validation. Face mask detection has several applications including real-time surveillance, biometrics, etc. Face mask detection is also useful for surveillance of the public to ensure face mask wearing in public places. Ensuring that people are wearing a face mask is not possible with monitoring staff;instead, automatic systems are a much better choice for face mask detection and monitoring to help manage public behaviour and contribute to restricting the outbreak of COVID-19. Despite the availability of several such systems, the lack of a real image dataset is a big hurdle to validating state-of-the-art face mask detection systems. In addition, using the simulated datasets lack the analysis needed for real-world scenarios. This study builds a new dataset namely RILFD by taking real pictures using a camera and annotating them with two labels (with mask, without mask) which are publicly available for future research. In addition, this study investigates various machine learning models and off-the-shelf deep learning models YOLOv3 and Faster R-CNN for the detection of face masks. The customized CNN models in combination with the 4 steps of image processing are proposed for face mask detection. The proposed approach outperforms other models and proved its robustness with a 97.5% of accuracy score in face mask detection on the RILFD dataset and two publicly available datasets (MAFA and MOXA). [ FROM AUTHOR] Copyright of Image & Vision Computing is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full . (Copyright applies to all s.)

AI Enabled Smart Campus for Health Safety and Monitoring

COVID 19 has had a major effect on society. In order to keep people's spacing, new requirements have been placed in place regarding the amount of users authorized in individual rooms in offices, shops, etc. Along with social distance, regular temperature verification at mall entrances are indeed permitted. An excellent embedded machine learning system is proposed in this work to identify face masks automatically and detect the body's temperature in a real-time application. The proposed system, in particular, utilizes a raspberry pi camera to capture real-time video simultaneously by identifying face masks with the help of a classification technique. The face mask detector is constructed by utilizing mobilenetv2 and imaging net pre-trained weights to consider three scenarios: wearing a mask correctly, wearing a mask incorrectly, and not wearing any at all. By placing a temperature gauge on a Raspberry Pi, a framework has also been developed for determining a person's body temperature. The numerical outcomes show the feasibility and performance of our integrated devices in compared to many cutting-edge research. This temperature and facemask detection device monitors a person's body heat and detects whether or not that person is wearing a facemask. Consequently, any organization's entrance could contain this device. In this study, the door is only released if the temperature is below 99° F, which would be calculated by the Electro Selective Pattern-32 images, the MLX sensor, and the fact that a person's face is 80% protected by a facemask. © 2023 IEEE.

Face Mask Detection Using YOLOv3

The COVID-19 is an unprecedented crisis that has resulted in several security issues and large number of casualties. People frequently use masks to protect themselves against the transmission of coronavirus. In view of the fact that specific aspects of the face are obscured, facial identification becomes extremely difficult. During the ongoing coronavirus pandemic, researchers' primary focus has been to come up with suggestions for dealing with the problem through rapid and efficient solutions, as mask detection is required in the current scenario, whether in public or in some institutions such as offices and other workplaces. Only detecting whether a person wears mask or not is not enough. There is another aspect of wearing the mask properly such that it covers all the required portion of the face to ensure there is no exposure to any viruses. To address this, we proposed a reliable technique based on image classification and object localization, which can be accomplished using YOLO v3's object detection in machine learning. © 2023, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

Research and Optimization of a Lightweight Refined Mask-Wearing Detection Algorithm Based on an Attention Mechanism

To address the current problems of the incomplete classification of mask-wearing detection data, small-target miss detection, and the insufficient feature extraction capabilities of lightweight networks dealing with complex faces, a lightweight method with an attention mechanism for detecting mask wearing is presented in this paper. This study incorporated an "incorrect_mask” category into the dataset to address incomplete classification. Additionally, the YOLOv4-tiny model was enhanced with a prediction feature layer and feature fusion execution, expanding the detection scale range and improving the performance on small targets. A CBAM attention module was then introduced into the feature enhancement network, which re-screened the feature information of the region of interest to retain important feature information and improve the feature extraction capabilities. Finally, a focal loss function and an improved mosaic data enhancement strategy were used to enhance the target classification performance. The experimental results of classifying three objects demonstrate that the lightweight model's detection speed was not compromised while achieving a 2.08% increase in the average classification precision, which was only 0.69% lower than that of the YOLOv4 network. Therefore, this approach effectively improves the detection effect of the lightweight network for mask-wearing.

Towards Face-to-Face Smart Classroom that Adheres to Covid'19 Restrictions

Smart classrooms have improved dramatically in recent years, especially during the period of the pandemic of Covid-19 when the lockdowns were imposed in reaction to the virus's spread. Governments endeavor to maintain learning stability and seek technological solutions to establish teaching continuity. Therefore, distance learning was a viable interim solution;nevertheless, not all students worldwide have access to digital learning resources, and because of a variety of other issues, online education may be a poor choice. In this paper, we propose a model for an intelligent face-to-face classroom that adheres to Covid-19's constraints. Our proposed system transmits a real-time warning to the classroom supervisor (teacher) if students are not wearing their masks properly or are not respecting the physical distancing during the session. We base our suggested system components on existing research in artificial intelligence and deep learning-based facial recognition systems. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Development of a Video Surveillance web Application for the use of Biosafety Equipment with Image Recognition for Workspaces

With the arrival of Covid-19, several preventive measures were implemented to limit the spread of this virus. Among these measures is the use of masks, both in open and closed public spaces. This measure has forced commercial establishments, workplaces, schools, hospitals, to maintain constant vigilance, upon entering their facilities, of the proper use of the mask, which should completely cover the nose, mouth and chin. However, this manual control is tedious and ineffective since most of the population is not able to correctly identify when a person has the mask on properly, with high error rates in the manual detection of the correct use of the mask according to surveys carried out. For this reason, this work proposes the automation of the detection of the proper use of the mask at the entrance to the work areas, also providing a follow-up panel of the recorded incidents. The effectiveness of the proposal was evaluated through the detection and categorization of a data set of more than 3000 images, resulting in an accuracy of 98.6%. © 2022 IEEE.

Identifying Face Masks with OpenCv and Deep Learning

During the course of this epidemic, the Corona virus had a significant influence not only regular lives but also on international business. Protecting one's appearance has recently emerged as a widespread fashion trend and can now be considered the norm. In the present day or in the future, a large number of individuals will be obliged to wear masks in order to protect not only themselves but also the people around as well as the surrounding area. Face recognition has emerged as an increasingly vital tool in the fight against global terrorism. As part of this work, we are developing an AI system that will be able to determine whether or not a person is concealing their identity by wearing a mask. It will be of assistance to us in preventing the virus from spreading across the environment. In order to construct this work, we require the assistance of Machine Learning (ML), deep learning (DL), and Neural Network (NN), all of which will assist us in realizing the purpose of this work. We needed jupyter notebook in order to complete this work, and we also needed to install numpy, opencv, tensorflow, and numpy as well as a learning tool. This strategy will assist us in identifying the individual who is concealing their identity by wearing a mask in the imageand in real life picture. Additionally, it is able to recognize and distinguish a moving mask or face. © 2022 IEEE.